💻 Local LLMs

Model Quantization, Inference Optimization, GGUF Format, Privacy-preserving AI

Feeds to Scour
SubscribedAll
Scoured 7677 posts in 172.5 ms
PRIMAL: Processing-In-Memory Based Low-Rank Adaptation for LLM Inference Accelerator
arxiv.org·1d
🏗️AI Infrastructure
Preview
Report Post
From 75% to 99.6%: The Math of LLM Ensembles
shibaprasadb.com·1d·
Discuss: Hacker News
🎯Hindley-Milner
Preview
Report Post
Privacy-Preserving Active Learning for heritage language revitalization programs with zero-trust governance guarantees
dev.to·23h·
Discuss: DEV
🏠Self-hosted AI
Preview
Report Post
Guardrails for trust, safety, and ethical development and deployment of Large Language Models (LLM)
arxiv.org·4h
🏠Self-hosted AI
Preview
Report Post
MLSN #18: Adversarial Diffusion, Activation Oracles, Weird Generalization
lesswrong.com·1d
🏠Self-hosted AI
Preview
Report Post
The three types of LLM workloads and how to serve them
modal.com·17h·
Discuss: Hacker News
🏗️AI Infrastructure
Preview
Report Post
Decoupling the AI Stack: How to Architect a Production-Grade Local LLM System
dev.to·5h·
Discuss: DEV
🏗️AI Infrastructure
Preview
Report Post
DiffuCoder: Understanding and Improving Masked Diffusion Models for Code Generation
machinelearning.apple.com·1d
⚡Incremental Computation
Preview
Report Post
MIT’s new ‘recursive’ framework lets LLMs process 10 million tokens without context rot
venturebeat.com·1d·
Discuss: Hacker News, r/technews
🏗️AI Infrastructure
Preview
Report Post
Using Local LLMs to Discover High-Performance Algorithms
towardsdatascience.com·2d
⚙️LLVM
Preview
Report Post
Quiz: How to Integrate Local LLMs With Ollama and Python
realpython.com·21h
🚀MLOps
Preview
Report Post
featurestorebook/mlfs-book: O'Reilly book - Building Machine Learning Systems with a feature store: batch, real-time, and LLMs
github.com·8h·
Discuss: Hacker News
🚀MLOps
Preview
Report Post
Everything Moe
ianbarber.blog·1d·
Discuss: Hacker News
📱Edge AI
Preview
Report Post
A Visual Guide to Quantization
newsletter.maartengrootendorst.com·2d
📱Edge AI
Preview
Report Post
Co-optimization Approaches For Reliable and Efficient AI Acceleration (Peking University et al.)
semiengineering.com·16h
⚡Hardware Acceleration
Preview
Report Post
Evolution of LLMs use by a programmer
asfaload.com·16h·
Discuss: Hacker News
💬Language Servers
Preview
Report Post
Ensemble Listening Model (ELM): State-of-the Art Foundation Model Accuracy. A Fraction of the Cost.
ensemblelisteningmodel.com·1d·
Discuss: Hacker News
🎙️Whisper
Preview
Report Post
Norm-Preserving Biprojected Abliteration
huggingface.co·2d·
Discuss: Hacker News
🔥PyTorch
Preview
Report Post
I replaced my ChatGPT subscription with a 12GB GPU and never looked back
xda-developers.com·13h
⚡Hardware Acceleration
Preview
Report Post
Can We Build an NX Bit for LLMs
bogdandeac.com·1d·
Discuss: Hacker News
⚡Hardware Acceleration
Preview
Report Post

Keyboard Shortcuts

Navigation
Next / previous item
j/k
Open post
oorEnter
Preview post
v
Post Actions
Love post
a
Like post
l
Dislike post
d
Undo reaction
u
Recommendations
Add interest / feed
Enter
Not interested
x
Go to
Home
gh
Interests
gi
Feeds
gf
Likes
gl
History
gy
Changelog
gc
Settings
gs
Browse
gb
Search
/
General
Show this help
?
Submit feedback
!
Close modal / unfocus
Esc

Press ? anytime to show this help